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Abstract 

The interest on networks of dynamical systems is increasing in the past years, especially because 
of their capability of modeling and describing a large variety of phenomena and behaviors. Particular 
attention has been oriented towards the emergence of complicated phenomena from the interconnections 
of simple models. We tackle, from a theoretical perspective, the problem of reconstructing the topology 
of an unknown network of linear dynamical systems where every node output is given by a scalar random 
process. Existing approaches are bayesian or assume that the node inputs are accessible and manipula- 
ble. The approach we propose is completely blind, since we assume no a-priori knowledge of the network 
dynamics and we make use of second order statistics only. We also assume that it is only possible to 
observe the node outputs, while the inputs are not manipulable. The developed reconstruction technique 
is based on Wiener filtering and provides general theoretical guarantees for the detection of links in a 
network of dynamical systems. For a large class of networks, that we name "self-kin", sufficient conditions 
for the detection of the existing links are formulated. The necessity of those conditions is also discussed: 
indeed, it is shown that they do not hold only in specific pathological cases. Thus, for any applica- 
tions needs, the exact reconstruction of self-kin networks can be considered practically guaranteed. For 
networks not belonging to this class those conditions are met by the smallest (in the sense of the least 
number of edges) self-kin network containing the actual one. Hence, for general networks, the procedure 
identifies a self-kin network that is optimal in the sense of number of edges. For networks not belonging 
to the self-kin class, conditions are met by the smallest (in the sense of the least number of edges) self-kin 
network containing the actual one. 

1 Introduction 

The interest on networks of dynamical systems is increasing in recent years, especially because of their capa- 
bility of modeling and describing a large variety of phenomena and behaviors. Particular attention has been 
oriented towards the emergence of complicated phenomena from interconnections of simple models (see, for 
example, HI [H S S]). 

Principal advantages provided by networked systems are three: a modular approach to design, the possibil- 
ity of directly introducing redundancy, and the realization of distributed and parallel algorithms. All these 
advantages have led to increased utilization of realizationof networked systems in the realization of many 
devices (see e.g. [ID- 
Interconnected systems are also successfully exploited to develop novel modeling approaches in many fields, 
such as Economics (see e.g. fT', IHI), Biology (see e.g. [21 UHl E] ) j Cognitive Sciences (see e.g. [12J), Ecology 
(see e.g. [T51 114| ) and Geology (see e.g. [T51 116| ). especially when the investigated phenomena are charac- 
terized by spatial distributions where multivariate analysis is preferred |17| . 

While networks of dynamical systems are well studied and analyzed in physics [TBI [IHl [10] and engineer- 
ing ^21j |22, 22} 1 there are fewer results that address the problem of reconstructing an unknown dynamical 



network, since it poses formidable theoretical and practical challenges [23]. However, unravelling the in- 
terconnectedness of a set of processes is of significant interest in many fields, and the necessity for general 
tools is rapidly increasing (see [221, [H] and [27| and the bibliography therein for recent results). Existing 
results derive a network topology from sampled data (see e.g. [51 [251 HZl [25j ) or to determine the presence 
of substructures (see e.g. j20[ I26j). The Unweighted Pair Group Method with Arithmetic mean (UPGMA) 
[29j is one of the first techniques proposed to reveal an unknown topology. It has found widespread use 
in the reconstruction of phylogenetic trees, and is widely employed in other areas such as communication 
systems and for resource allocation [3D]. UPGMA identifies a tree topology relying on the observation of 
leaf nodes, theoretically guaranteeing a correct identification only on the strong assumption that an ultra- 
metric is defined among the leaves. Another well-known technique for the identification of a tree network is 
developed in [5] for the analysis of a stock portfolio. The authors identify a tree structure according to the 
following procedure: i) a metric based on the correlation index is defined among the nodes; ii) such a metric 
is employed to extract the Minimum Spanning Tree |31| which forms the reconstructed topology. Many 
improvements over [5] have been devised especially using shrinking techniques to estimate the correlation 
matrix [321 133| or refining its estimate via high frequency sampling |34| . A reliability index for any link can 
also be defined using bootstrap techniques [33]. However, in [T^ a severe limit of this strategy is highlighted, 
where it it is shown that, even though the actual network is a tree, the presence of dynamical connections 
or delays can lead to the identification of a wrong topology. In [35] a similar strategy, where the correlation 
metric is replaced by a metric based on the coherence function, is numerically shown to provide an exact 
reconstruction for tree topologies. Finally, in [5S] it is shown that a correct reconstruction can be guaranteed 
for any topology with no cycles. 

An approach for the identification of more general topologies is developed in the area of Machine Learning 
for Bayesian Networks (BNs) [371|3S]. The results presented in this paper present have strong connections 
with this area. Indeed, the topology reconstruction of BNs is based on the fact that the conditional expec- 
tation operator to estimate one signal is determined only by the signals belonging to its Markov Blanket 
|39| . However, the most significant difference between BNs and the network models of this paper is that in 
BNs the network graph can not have loops. The fact that the Wiener filter applied to the class of network 
models studied in this paper has properties similar to BNs even in presence of loops can not be considered 
trivial. Moreover, we tackle the problem of the robustness of the reconstruction in terms of power spectral 
densities of the noise corrupting the signals. 

In [26] different techniques for quantifying and evaluating the modular structure of a network are compared 
and a new one is proposed trying to combine both the topological and dynamic information of the complex 
system. However, the network topology is only qualitatively estimated. In |25j a method to identify a net- 
work of dynamical systems is described. However, primary assumptions of the technique are the possibility 
to manipulate the input of every single node and the possibility of conducting many experiments to detect 
the link connectivity. 

In [40] an interesting and novel approach based on auto-regressive models and Granger-causality [41] is pro- 
posed for reconstructing a network of dynamical systems. This technique relies on multivariate identification 
procedure to detect the presence of a link, but still no theoretical sufficient or necessary conditions are de- 
rived to check the correctness of the results. 

More recently, in [57] and [12] interesting equivalences between the identification of a dynamical network 
and a sparsification problem are highlighted, suggesting the difficulty of the reconstruction procedure |43j . 
Summarizing, to the best knowledge of the authors, apart from the results in [36] . which are limited to tree 
topologies, no general theoretical guarantees about the correct reconstruction of network links are provided 
if there is no possibility of directly manipulating the system. 

In this paper the problem of reconstructing a network of dynamical systems where every node represents an 
observable scalar signal and the dynamics is linear and represented by the connecting links is addressed. The 
problem, when analyzed from a systems theory point of view, provides a method for correctly identifying 
a topology that belongs to the pre-specified class of self-kin networks. Moreover, if the network does not 
belong to such a class, conditions about the optimality of the identified topology according to a certain 
criterion is estabilished. From this perspective, sufficient conditions for the exact reconstruction of a large 
class of networks, which we name self-kin, are derived. Examples of self-kin networks are given by (but 
not limited to) trees, and ring topologies [44]. In the case the network is not self-kin, the reconstructed 
topology is guaranteed to be the smallest self-kin network containing the actual one. The theory developed 



2 



is not bayesian and relies directly on Wiener filtering theory. Conditions derived for the detection of links 
are based on sparsity properties of the (non-causal) Wiener filter modeling the network. Indeed, conditions 
under which the Wiener filter smoothing a signal of the network is "local" are derived. From a different 
perspective, another important contribution of the paper is given by providing conditions for a local and 
distributed implementation of the Wiener filter. 

The paper is organized as follows. In Section [5] examples are provided to provide the basic intuition 
behind central ideas; in Section [3] definitions are provided based on standard notions of graph theory; in 
Section 2] the main problem is formulated; in Section [S] the main results are provided for non-causal Wiener 
filtering; in Section [5] the results are extended to causal Wiener filtering and Granger causality; in Section [7] 
the implementation of algorithms for the detection of network topologies are discussed for different scenarios; 
in Section [S] the robustness of the identification is addressed; eventually, in Section IH] numerical simulations 
illustrating the effectiveness of the methodology are presented. 

Notation: 

The symbol := denotes a definition 

||a;||: 2-norm of a vector x 

W'^: the transpose of a matrix or vector W 

W*: the conjugate transpose of a matrix or vector W 

Xi or {x}i: the z-th element of a vector x 

Wji. the entry (j, i) of a matrix W 

Wj^: j-th row of a matrix W 

W^,i : i-th column of a matrix W 

XV- when V — {vi, ...,Vn) is a n-tuple of natural numbers denotes the vector {xy^ ■■■ Xv„)'^ 
\A\: cardinality (number of elements) of a set A 
E[-]: mean operator; 

Rxy{t) := E[X {t)Y'^ {t + t)]: cross-covariance function of wide-sense stationary vector processes X and Y; 

Rx{t) := Rxx{t): autocovariance; 

Z{-): Zeta-transform of a signal; 

^xy{z) ■— Z{Rxy{t))- cross-power spectral density; 

^x{z) :— ^xx{z)- power spectral density; 

with abuse of notation, ^xvii^) = *I'xy(e"^) for spectral densities and W{uj) — M^(e'") for transfer func- 
tions; 

bi : i-th element of the canonical base of M" . 

In this sections a representation of dynamical networks in terms of oriented graphs is presented. 
In this representation, every node Nj represents a scalar time-discrete wide-sense stationary stochastic process 
Xj, while every directed arc form a node Ni to a node Nj represents a possibly non-causal transfer function 
Hji{z) 7^ 0. The absence of such an arc implies that Hji{z) — 0. Every node signal is also implicitly 
considered affected by an additive process noise ej . Given the graphical representation, the dynamics of the 
network is described by 




(1) 



For example, in Figure [T] a network is represented, the dynamics of which corresponds to 



xi = ei 



X2= €2+ H25{z)x5 

2^3 = 63 + H3l{z)xi + H32{Z)X2 

X4 = 64 + H43{z)x3 

2^5 = 65 + i?5i {z)xi + Hzi{z)xi. 
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Figure 1: An example of the graphical representation of dynamical networks. Every node represents a 
stochastic signal and the edge from a node iV^ to a node Nj represents the transfer function Hji(z). Every 
node signal is also implicitely affected by a process noise. 

2 Illustrative examples 

In this section special network configurations of dynamical systems are presented where the Wiener filter 
producing the estimate of a node signal xq from the other node signals Xi has the characteristic of being 
sparse. In most cases, the presence of a non-null entry in the Wiener filter corresponds to the presence of a 
direct link between the signal Xi and the signal xq . In the following sections it will be shown that this result 
holds in general for the class of self-kin networks, a class of networks defined later. Moreover if the network is 
not self-kin it will be shown that the presence of a non-null entry in the Wiener filter identifies the presence 
of a link in the "smallest" (in the sense of number of edges) self-kin network containing the original one. 

2.1 Wiener Filtering of a downstream signal 

Consider a network of four systems as represented in Figure [5] where 

X3 = 63 

Xi^i = e,;_i + H.,^i^i{z)xi 

with Hi^i^i{z) 7^ three possibly non-causal SISO transfer functions for i = 1,2,3 and with signals 
mutually uncorrelated for i = 0, 1, 2, 3. Consider the Wiener filter that provides the estimate xq of xq based 




Figure 2: A cascade network. The Wiener filter estimating xq from the other signals makes use only of the 
"parent" signal xi which is directly linked to xq. 
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on the other signals, xi, X2 and X3. It can be shown that 

(Xl 
X2 
X3 

(Xl 
X2 
X3 

is the best estimate of Xq in the least squares sense. Indeed, 

E[{xo - xo)xi] = £^[60^^] = 
for i — 1,2,3. Thus, from the Hilbert projection theorem |45) . 

1^0(2) := (VKoi(z) Wo2iz) Wo3{z)) 



(2) 



(3) 



is the Wiener filter providing the best estimate for 2:0 US]- In this case, the only non-null entry of Wq 
correctly detects that there is a connection between the node and the node 1. 

2.2 Wiener Filtering of an upstream signal 

Consider a network of four systems as represented in Figure [3] with 



Xq = eo 

Xi+i = Hi+is{z)xi + Ci+i 



(4) 
(5) 



where are three possibly non-causal SISO transfer functions for i — 1,2,3 and with signals 

mutually not correlated for i = 0, 1, 2, 3. The Wiener filter that provides the estimate xq of xq making use 







Figure 3: A cascade network. The Wiener filter estimating Xq from the other signals makes use only of the 
"child" signal xi which is directly linked to xq. 

of the other signals xi, X2 and X3 is such that 

Xl 

io = (Woi(z) W^2{z) Wo3{z)) I X2 

X3 



|ffl0(z)|2$.„{z) + $e, 








Again in this case, there is one only non-null entry in the Wiener filter corresponding to the link between 
the node and the node 1. 



2.3 Wiener Filtering of a loop 

In the two previous cases the network configurations did not involve loops and the resulting Wiener filter had 
the property of having non-null entries corresponding to the node signals immediately connected to the node 
of interest. The identification of network topologies with loops is a challenging problem [8l[T7]. Indeed, most 
techniques deal with networks with no cycles [361. The presence of a loop leads to more complex relations 
between the node signals, especially in terms of the covariance function and (cross)-spectral densities. Thus, 
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it is interesting to note that the absence or presence of loops does not seem to affect the sparsity of the 

Wiener filter as shown in the following example [36]. 

Consider a network of four systems as represented in Figure where 

for i = 0, 3 and 

Mmod m '■— min{(7|(7 = n + km > and k G Z}. (6) 
Assume also that the signals are mutually not correlated. It is possible to show that the best least squares 



(a) (b) 

Figure 4: A loop network (a): the Wiener filter estimating xq from the other signals makes use only of the 
"child" signal xi and the parent signal X3 which are directly linked to xq A more general network (b): the 
Wiener filter estimating xq from the other signals makes use of the signal X2 which is directly linked to it, 
but also of the signal xi which is not. 

estimate of zq, based on xi, X2 and xa, is given by 



Xi 

io = (Woi(z) W^oaW) I X2 | = 

<I>eofflo(2)' 



(1 




It is to be noted that the signal X2 , which is not directly connected to xq , is not used in the optimal estimate 
of Xq. Thus, in all the examples presented so far the node signals actually employed by the Wiener Filter 
are the signals corresponding to nodes directly connected to the node signal being estimated. This example, 
along with the previous ones, leads to the conjecture that the Wiener Filter can be used as a tool to identify 
which nodes are connected to a specific node of interest by checking wether the corresponding entries of 
the Wiener filter are null or not. Unfortunately, the situation is more complex as shown in the following 
example. 
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2.4 Wiener filter using a not directly connected signal 

Consider a network of four systems as represented in Figure HJa where 

Xq = eo (7) 
xi = ei (8) 

X2 = H2,o{z)xq + H2,l{z)xi + €2 (9) 
2:3 = ■ff3,2(2:)a;2 + 63 (10) 

and the noises Cj are mutually not correlated. In this example, the Wiener filter providing the estimate xq 
of Xq using the other signals of the network is given by 



xq = {wm wm) 

{~H2i{z) 1 0) 




^eAz)\H20{zW+^eAz) 

In this case the Wiener filter estimating xq from the other signals makes use not only of the signal X2 which 
is directly linked to it, but also of the signal xi which is not. 

After the analysis of these examples, it is natural to ask to what extent and under which assumptions it 
is possible to reconstruct the topology of a network of linear dynamical systems measuring the node signals 
and if the Wiener filter can be a useful tool for accomplishing this identification procedure. 



3 Preliminary definitions 

In this section, basic notions of graph theory, which are functional to the following developments, will be 
recalled. For an extensive overview see |31) . First, the standard definition of undirected and oriented graphs 
is provided. 



Definition 1 (Directed and Undirected Graphs). An undirected graph G is a pair {V,A) where V is a set 
of vertices or nodes and A is a set of edges or arcs, which are unordered subsets of two distinct elements of 
V. 

A directed ( or oriented) graph G is a pair (V, A) where V is a set of vertices or nodes and A is a set of edges 
or arcs, which are ordered pairs of elements of V . 



In the following, if not specified, oriented graphs are considered. 



Definition 2 (Topology of a graph). Given an oriented graph G = {y,A), its topology is defined as the 
undirected graph G' = {V,A') such that {Ni,Nj) € A' if and only if {Ni, Nj) € A or {Nj,Ni) S A, and 
top{G) := G'. 



The topology of an oriented graph G is the undirected graph G' obtained by removing the orientation 
from any edge. An example of a directed graph and its topology is represented in Figure [5l 



Definition 3 (Children and Parents). Given a graph G = (V, A) and a node Nj G V , we define the children 
of Nj as Cg{Nj) := {N^\{Nj,N,) G A} and the parents of Nj as Vg{Nj) := {Ni\{N^,Nj) G A}. 
Extending the notation, children and the parents of a set of nodes are denoted as follows 

Cg{{N,,,...,N,^}) := UI!LiCg(A^,J 
rG{{N,,,...,N,^}) ur=i7'G(A^,J. 
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Figure 5: A directed graph (a) and its topology (b). 

Definition 4 (Kins). Given an oriented graph G = {V,A) and a node Nj € V , kins of Nj are defined as 

ICaiNj) {N,\N, ^ Nj and N, e Cg{Nj) U 
U Vg{Nj) U VGiCaiN,))}. 

Kins of a set of nodes are defined in the following way 

/CG({iV,,,...,iV,„J) :=UT^MN,,). 

Definition 5 (Proper Parents and Children). Given an oriented graph G = {V,A) and a node Nj, Ni is a 
proper parent (child) of Nj if it is a parent (child) of Nj and Ni ^ VGiCdNj)). Ni is a proper kin if it is a 
kin and N, ^ Vg{Nj) U Cg{Nj). 

Note that the kin relation is symmetric, in the sense that Ni £ ICg{Nj) if and only if Nj £ JCg{Ni). 

Definition 6 (Kin-graph). Given an oriented graph G = {V,A), its kin-graph is the undirected graph 
G = {V,A) where 

A {{N,, Nj}\N, £ JCg{Nj) for all j}. 

and it is denoted as kin{G) ~ G. 

A directed graph and its kin-graph are represented in Figure [51 Note that the kin-graph of G is an 
undirected graph. It could be defined as a directed graph, but, because of the symmetry of the kin relation, 
a directed graph contains exactly the same information. Moreover such a choice is motivated by the following 
definition 
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(a) (b) 
Figure 6: An oriented graph (a) and its kin topology (b). 



Definition 7 (Self- kin Graph). An oriented graph G is self-kin if 

top{G) = kin{G). 

An example of self- kin network is given in Figure [T] Many graphs are self- kin, such as oriented trees and 
rings [31]. 

Definition 8. Let £ be a set containing time-discrete scalar, zero-mean, wide-sense, stationary random 
processes such that, for any ei,ej £ £, the power spectral density $e.e^(z) exists, is real rational with no 
poles on the unit circle and given by 

where A(z) and B{z) are polynomials with real coefficients such that B{z) ^ for any z € C, with \z\ = 1. 
Then, £ is a set of rationally related random processes. 

Definition 9. The set '^J- is defined as the set of real-rational SISO transfer function with no poles on the 
unit circle {z e C| \z\ — 1}. 

Definition 10. Given a SISO transfer function H{z) G '^J-, represented as 

oo 

H{z)= J2 ^kz-"", (12) 

k— — OG 

we define the causal truncation operator as 

oo 

{i?(z)}c:-5]/ifcZ-^ (13) 

k=0 

Lemma 11. For every H{z) E , we have that {H{zy\c G 

Definition 12. The set is defined as the set of real-rational SISO transfer functions in '^T such that 

{H{z)}c^H{z). (14) 
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Figure 7: A ring network is always a self-kin network. 



Definition 13. Let £ be a set of rationally related random processes. The set is defined as 
Lemma 14. The set is a vector space with the field of real numbers. Let 

< Xl,X2 >:= RxiX2{0) = / '^XiX2{(^), 

J — TT 

which defines an inner product on with the assumption that two processes Xi and X2 are considered 
identical if xi{t) = X2{t), almost always for any t. 

Proof. See supplemental material. □ 

For any x G '^TS, the norm induced by the inner product is defined as ||a;|| :— y/< x, x >. 
Definition 15. For a finite number of elements xi, e '^J^£, tf-span is defined as 

tf-span{xi, ...,Xm} ■■= 

:= ja; = ^ ai{z)xi \ ai{z) e . 
Lemma 16. The tf-span operator defines a subspace of^TE. 
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Proof. The proof is left to the reader. 



□ 



Definition 17. For a finite number of elements xi,...,Xm € 



*J^£, c-tf-span is defined as 



c-tf-span{xi,...,Xm} ■= 




X = '^ai{z)xi I ai{z) € 



i=l 



Lemma 18. The c-tf-span operator defines a subspace of 



Proof. The proof is left to the reader. 



□ 



The following definition provides a class of models for a network of dynamical systems. 

Definition 19. Let I = (1, ...,n)'^ and consider the triplet Q = {G,T-L,ei) where G = {y,A) is a graph with 

n vertexes {Nj}j^i „; TL : A ~> "J^ is a function associating a, possibly non-causal, transfer function 

Hji{z) e ^J-, with no poles on the unit circle, to any edge (Ni.Nj) E A; and £ := ej = (ei, e„)"^ is an 
ordered n-tuple of rationally related random processes. G is a Linear Dynamic Graph (LDG) if the following 
conditions are satisfied 

• {Ni,Nj) e A implies {Nj,Ni) ^ A 

• ^acj (i^) = for i 7^ j and for all u) €M. 

The output Xj of the dynamic of a LDG is defined as 



where the entry {j,i) of the transfer matrix H{z) is given by the transfer function Hji{z). The LDG is 
well-posed if the matrix {X — H{z)) is invertible, and both {I — H{z)) and {I — H{z))~^ have full normal 
rank and no poles on the unit circle. This implies that there is a transfer matrix T{z) = [I — H{z)]~^ such 
that xj = T{z)ei. Interpreting T{z) as a possibly non-causal, linear transformation, it follows that Xi e 
for any i = 1, ...,n. 

The LDG is causal if each entry of H{z) and each entry ofT{z) is in 

A LDG is a complex interconnection of linear transfer functions Hji{z) connected according to a graph 
G and forced by stationary additive mutually uncorrclatcd noise. The following definitions will be useful for 

determining sufficient conditions for detection of links in a network. 

Definition 20. A LDG Q = (G, 'H,e/) is topologically detectable i/$ej('^) > for any co £ [— tt, tt] and for 

any i — 1, n. 



4 Problem Formulation 

Problem 21. Consider a well-posed LDG Q = {G,'H,£) where the graph G is unknown. Given the Power 
( Gross-) Spectral Densities of {a;j}i=i,...,„, reconstruct the unknown topology of the graph G of the LDG Q. 




for any j = 1, ...,n. In a matrix form it is possible to write the network dynamics of a LDG as 



Xi = ei + H{z)xi 



(15) 
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5 Sparsity of the non-causal Wiener Filter 

First, a lemma is provided that guarantees that any element in tf-span{a;i}i=i „ admits a unique repre- 
sentation if the cross-spectral density matrix of its generating processes has full normal rank. 

Lemma 22. Let q and xi,...,Xn be processes in the space '^TE. Define I := (l,....,n), and suppose that 
X G tf-span{xi\i=i^,,,^n o-nd that <^xixi{'^) > almost for any uj G [— 7r,7r]. Then there exists a unique 
transfer matrix H{z) such that q = H(z)xj. 

Proof. Note that if H{z) is such that H{z)xj — 0, then 

= o = i/H$,,,,Hii*H. (16) 

Since ^^xixii^) > almost everywhere, we have H{uj) = almost everywhere which implies that H{z) — 0. 
Now, by contradiction assume that q = Hi{z)xi = H2{z)xj, with Hi{z) ^ H2{z). Then = \H2{lo) — 
Hi{uj)]^,^,Xuj)[H2{uj) - Hi{lu)]* implying that Hi{z) = H2{z). □ 

A specific formulation of the non-causal Wiener filter is introduced for the defined spaces. 

Proposition 23. Let x and a;i,...,a;„ be processes in the space '^T£. Define L :— (l,....,n) and X :— 

tf-span{xi^ Xn}. Consider the problem 

mi\\x-q\\\ (17) 
qex 

If ^xA'^) > 0, for UJ G [— TT, vr], the solution x Cz X exists, is unique and has necessarily the form x ~ W{z)xi 
where 

W(z) = $,,,(z)$,,(z)~\ 
Moreover, it holds that x is the only element in X satisfying, for any q € X , 

<x-x,q>=0. (18) 
Proof. Observe that, since q £ X, the cost function satisfies 

\\x-W{z)xi\\^ = 

<i>xx{uj) + PF(w)$:r^x,(w)VF*(w) + 

- ^,,MW*{io) - M^(w)$,,,(w). 

The integral is minimized by minimizing the integrand for all lu G tt, vr]. It is straightforward to find that 
the minimum is achieved for 

w{uj) = ^^^,{uj)^^,^Aujy^. 

Defining the filter W{z) = ^xxj{z)^xjxj{z)~^ a real-rational transfer matrix is obtained with no poles on 
the unit circle that has the specified frequency response. Thus x = W{z)xi G X minimizes the cost (fT7|). As 
a consequence of the Hilbert projection theorem (for pre-Hilbert spaces) Equation (|18l) is satisfied for x if 
and only if it is the unique element of the subspace X minimizing p7p [45]. If ^xixi (z) > 0, the uniqueness 
of W{z) follows from Lemma [22] □ 

In the following definition a notion of conditional non-causal Wiener-uncorrelation is given. 

Definition 24. Let q, Xi, Xn be processes in the space ^J-'£. Define I :— (1, n) and X :— tf-span{xi, a;„}. 
For any i G {1, n}, the process Xi is non-causally Wiener-uncorrelated with q given the processes {xj^^^^i 
if the i-th entry of the Wiener filter to estimate q from xj is zero, that is 

^9x.*^;.,&. = o. (19) 
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The following lemma provides an immediate relationship between non-causal Wiener-uncorrelation and 
the inverse of the cross-spectral density matrix. This result presents strong similarities with the property of 
the inverse of the covariance matrix for jointly Gaussian random- variables. Indeed, it is well-known that the 
entry of inverse of the covariance matrix of n random variables xi, a;„ is zero if and only if Xi and 
Xj are conditionally independent given the othe variables. 

Lemma 25. Letxi,...,Xn he processes in the space . Define I := {1, ....,n). Assume that has full 
normal rank. The process Xi is non-causally Wiener-uncorrelated with Xj given the processes {xk}k^ij, if 
and only if the entry {i,j), or equivalently the entry (j, i), of ^^^(z) is zero, that is, for i ^ j, 

bj^-^ = bj'f-^b, - 0. (20) 

Proof. Without any loss of generality, let j = n. Define the vector Xn = (a^i, Xn-iY' determine the 
non-causal Wiener filter Wnn estimating x„ from Xn- 

Xn= £n + Wnn{z)Xn (21) 

where the error has the property that <i>e^a;_(z) = 0. Define r := (a;^T,e„) and observe that 

-Wn^iz) 1 ) ^5 = ( 1^„^(Z) 1 ) (22) 



Compute 



WMzr^l^^ .«rVwL. ? (23) 

(24) 



1 AO / V Wnn{z) 1 



The assertion is proven by premultiplying by 6^ and post-multiplying by bi □ 

The following theorem provides a sufficient condition to determine if two nodes in a LDG are kins. 

Theorem 26. Consider a well-posed and topologically detectable LDG. Let xi,...,Xn G ^J-£ he the signals 
associated with the n nodes of its graph. Define Xj = tf-span{xi\i^j . Consider the problem of approximating 
the signal Xj with an element Xj G Xj , as defined below 

.inf \\xj ~xjf . (25) 
Then the optimal solution Xj exists, is unique and 

(26) 

where Wji{z) ^ implies (Ni,Nj) G kiniG). 

Proof. The LDG dynamics is given by a; = (I — H{z))^^e implying that can also be represented as 

^-^^{I^Hr%\l-H). (27) 

Consider the j-th line of . We have 

6j$-i = {bj - ) $- \I-H). (28) 

The row vector (&J — H^-) has zero entries corresponding any index k such that k ^ j that is not a parent 
of j. Since $e is diagonal the i-th column of ^^^{T — H) has zero entries for any k ^ i and is not a parent 
of i. Given i ^ j, if i is not a parent of j and i is not a child of j and i and j have no common children 
(they are not coparents), it follows that the entry {j,i) of is not zero. Using Lemma ([25l) the assertion 
is proven. □ 
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The following result provides a sufficient condition for the reconstruction of a link in a LDG. 

Corollary 27. Consider a LDG Q ^ {G,H,ej) with G = {V,A) Assume V = {A^i}i=i,...,„ and let X := 
{a;i}i=i,...,n be the set of processes Xi corresponding to the nodes Ni. Let Wji{z) he entry of the non-causal 
Wiener filter estimating Xj from {xk}k^j corresponding to the process Xi. If Q is self-kin, then Wji{z) ^ 
implies {Nj,Ni) e top{G). 

Proof Since g is self-kin, Vg{Nj) U Cg{Nj) U 7'g(Cg(^j)) = Cg{Nj) U VciiNj)). Thus, from the previous 
theorem the assertion follows immediately. □ 

The following lemma is a key result to explicitly determine the expression of the Wiener filter for a LDG 
in the non-causal and in the causal scenarios. 

Lemma 28. Consider a well-posed LDG Q = (G, %, ej). Assume V = and let X :— {xi}i=i^,,,^n 

be the set of processes Xi corresponding to the nodes Ni. Fix j £ {1, and define the set 

C ■.= {c\N,eCG{Nj)} = {ci,...CnJ 
containing the indexes of the Uc children of Nj. Then, for i ^ j, 



Xi € tf-span l< IJ (efe + Hkj{z)ej) I |J {e^} 
I Uec J I fc^cu{j} 



Furthermore, if Q is causal, 



x^ g c-tf-span l\ IJ (efc + Hkj{z)ej) \ u < [j {e^} I \ 
[Uec J [hcu{]} j j 



Proof. Define 



Sk 
£k 







= ek + Hkj{z)ej 
= efc 

?fe := y^^Hki{z)x^ 
C/c := Xk 



if fc e C 
if ki{C}U {j} 

if - J 

if fc ^ J 



(29) 



and, by inspection, observe that 



[I-H{z)]^i = ei. 



Since Q is well posed, [I — H{z)] is invertible implying that the signals {£,i}i=i „ are a linear transformation 

of the signals {si}i=i „. For i ^ j, we have 

Xt = ^i <E tf-span{efe}fe=i,...,„ = tf-span{efe}fe^j 

where the first equality follows from and last equality follows from the fact that = 0. The causality 
of Q also implies that 

Xt = c-tf-span{£fc}fc^j. 



This proves the assertion. 



□ 



In the case of a well-posed and topologically detectable LDG, the following theorem completes Theorem[26l 
providing an explicit expression for the non-causal Wiener filter W since the solution of the minimization 
problem (|25|) is known to be unique. 
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Theorem 29. Consider a well posed and topologicaly detectable LDG Q — {G,l-L,ei) with G = (V", 
V = {Ni, ...,Nn}. Define I = {1, ...,n)^ and Ij = {1, — 1,0, j + 1, ...,n). Consider an auxiliary process 
eo such that $eoe/ = and $eo = 1- Define, 

Cjiiz) = {$e,i?:,(z)[$e, {z)H,j{z)H:^{z) + <l>e,^ {z)]-% (30) 

Pji{z) = (l - CMH.jiz)) Hji{z) (31) 

I —Cji,{z)H^i{z) otherwise. ^'^'^^ 

These definitions do not depend on the choice on eo. Consider the estimate xj for xj provided by the 
non-causal Wiener filter using the other signals {xi}i^j 

Xj='^WjiXi. (33) 

Then, we have that 

Wj, (z) = C,i {z) + P,, (z) + Kji {z) . (34) 
Proof. Define the following set of indexes 

C~{c\N,€CG{Nj)}^{ci,...CnJ 

Pi := {p\Np e VGiNi)}/{j} = {pn, ...pmj 
K ~ {k\Nk e JCg{N,)} = {h, ...kn,} 

for any I = 1, n. 

The set C contains all the indexes of the ric children of Nn while the set K contains all the nu indexes of 
the kins of Nj. The set Pi contains all the rip, parents (but Nj) of a generic node Ni. 
For any i ^ j, define 

£i := Xi - ^Hij{z)Hjk{z)xk -^Hik{z)xk. (35) 

Note that, for any i ^ j, 

£i = e^ + H^j{z)ej. (36) 

Also note that 

:= Xj - ^Hjk{z)xk, (37) 



The solution to the minimization problem 



is given by 



arg min \\ej - q\\ = (38) 

tt-span I Ciji^j 

= arg min ||e,. - gf + ||Q .(z)eof = (39) 

arg min \\ej - q\\ (40) 



ij =^Cj^iz)ei, (41) 
»=i 
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where the process eo has played the role of a placeholder forcing Cjj = 0, without affecting the values of 
Cji{z), for i ^ j. Now, let us consider the problem 

arg min \\xj - q\\. (42) 



From (j37p . its solution xj satisfies 



hj Hjk{z)xk+ arg min \\ej - q\\ = (43) 

k 

= ^Hjk{z)xk+&rg min \\ej - q\\ (44) 



where the last equality has been obtained by using Lemma (1281) . Thus we have 

Xj = ^ WjiXi = ^ Hjk{z)xk + ^ QiEi (45) 

Substituting the espression of e.^, i 7^ j, as a function of a;^, i 7^ j, the assertion is proven. □ 

Theorem [55] gives the expression of the entry Wji of the topological filter as the sum of the three 
components Cji, Pji and Kji. The three components have a graphical interpretation: Cji{z) is a the 
contribution corresponding to the fact that Ni is a child of Nj\ Pji{z) is the contribution present when Ni 
is a parent of Nj ; and Kji (z) is a term present when there is a "co-parent" relation. 

Lemma 30. Given a well posed LDG, consider Equation llc)U\} . Equation iSl]) and Equation hS^) . Then 

• CJ^{z) ^0 if and only if N, e Cg{Nj) 

• Pj,(z) ^0 if and only if N, G Vg{Nj) 

• kj,{z) ^ implies N, G Vg{Cg{Mj))\Nj . 
Proof. Evaluate 

= $e,i/:,(z)[<i>e, {z)H,j{z)H:^{z) + <f>e.^. {z)]'^ = 

= <^e,{z)H:^{z)<^>-^Xz) [l+$e^(z)i/,,(z)ff;.(z)<i>,,^(z)-i]"' = 

(-1)' 



a>,^.(z)ij;.(z)<i>-;(z) i-J_||i/;.(z)ci>-liJ,^.(^)ll"$e,(^)^ 

m— 

$e.(^)iy:, (2)^7^2) ■ 

' ' ^+||i7:,(z)$- (z)F,,-(z)||$e,(^) 



Thus Cji ^ for any Ni G CciNj). Furthermore, it follows 

\\C,4u)H,,{u:)\\<l, (46) 

implying, from ((5T|) , that 

P,,(^) 7^ 0. (47) 
for any N, G VciN-j). □ 

From Lemma [5D1 Theorem can be recovered, since Cji{z) = Pji{z) = Kji{z) = for all the nodes 
Ni that are not kin of Nj. However the only conditions according to which Wji = Wij — even though 
{Ni, Nj} G kin{G), making the link not detectable, are found. 
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Theorem 31. Consider a well posed LDG G = {G,%,£) with G = {V,A), V = {Ni,...,Nn}. {Ni,Nj} G 
kin{G) and Wji ~ Wij — if and only if one of the following condition is satisfied 

• Cji{z) = -kji{z) and Pij{z) = -kij{z) 

• Pji{z) = -Kji{z) and Cij{z) -Kij{z) 

Proof. Indeed, since in a LDG CciNj) n VciNj) — 0, it follows that, for any couple Cji{z) = or 

Pji{z) = 0. The conditions, then, follow in a straightforward manner. □ 

Theorem [31] shows that the condition under which a link present in the kin topology leads to two 
null entries {Wji — Wij — 0) in the topological filter can be considered a pathological case. Indeed two 
simultaneous cancellations between the kin term and the other term (parent or child) must happen. Moreover, 
if a node is simple, such a cancellation is not possible. 

6 Sparsity of causal filtering operators 

First, we need to introduce the following lemma. 

Lemma 32. Let x and Xi,...,a;„ be processes in the space ^J-E. Define I := {!,...., n). Assume that 
^xxii'^) = for all uj G [— 7r,7r]. Then < x,y >= for all y G tf-span{xi}i^i^,,,^n- 

Proof. As y G tf-span{a::j}i=i_ „, it follows that there exist ai{z) G '^J- such that 

n 

2/ = ^ ai{z)xi = ai{z)xi, 

i=l 

where ai{z) = [ai{z), ...,a„(z)] is a row vector of real-rational transfer functions. Then it follows that 

-TT 

□ 

Now, a specific formulation of the causal Wiener filter is introduced for the defined spaces. 

Proposition 33. Let x and Xi,...,Xn be processes in the space '^J-£. Define L (l,....,n) and X := 
c-tf-span{xi, Xn}- Consider the problem 

mi\\x-qf. (48) 
qex 

Let S{z) be the spectral factorization of ^xi{<-^) = S{ijj)S*{ui). If^xiii-^) > 0, for oj G [— 7r,7r], the solution 
x^'^^ G X exists, is unique and has the form 

=Ty(")(z)a;/ 

where 

W^'\z) = {^.,x^{z)<^.,,{z)-^S{z)}cS-\z). 
Moreover x^'^^ is the only element in X such that, for any q G X , it holds that 

<x- x^''\q>=0. (49) 
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Proof. Observe that W^'^\z) is rational and causal. Let us prove that, for any causal H{z), we have 

< >= (50) 

Define rj := S~^{z)xi, and observe that S{z), S{z)^^{z) e ^J-^, since S{z) is the spectral factor of ^xi{z) 
that is real-rational and has full rank on the unit circle. The signal r/ is white since 

$r,(z)=In. (51) 

Define 

={<i>„,(z)$-/(z)}cr, (52) 

= {<i>,,,(z)<i>-i(z)5(z)}c5-i(z)a:z. (53) 

observing that x^'^^ € X since it is obtained by composing transformations in Also observe that 

^xri{z)^r^{^) is the non-causal Wiener filter estimating x from r/. Let the strictly anticausal component 
of such a filter part be 

{$,,,(z)$-i(z)}sA <i>..,(z)$-/(z) - {$..,(z)$-/(z)}c. (54) 
Now, for a H{z) E ^F, compute 

<x-x, Hxi >=< X - W^^^Srix, HSri >= (55) 

< a; - $,,,(z)$-/(z)r/ + (z)$-i(z)}^cr-/, -ff5r/ >= (56) 

< {$,,,(z)$-i(z)}sAr/,-ff5r/ >= 0. (57) 

where Lemma [5^ has been used to prove that < x—^xri{z)^ri^{z)rj,H{z)S{z)ri >= and the last equality 
follows from the causality of H{z)S{z), the strictly anti-causality of {^xri{z)^ri^{z)}sA and the whiteness 
of r/. From the Hilbert projection theorem, i'-'^^ is the unique process minimizing the cost (pS)) . □ 

The following theorem proves the sparsity of the causal Wiener filter stating that the causal Wiener filter 
estimating xj from the signals Xi, i ^ j, has non-zero entries corresponding to the kin signals of Xj. 

Theorem 34. Consider a well-posed, causal and topologically detectable LDG. Let xi, ...,Xn G ^TE he the 
signals associated with the n nodes of its graph. Define Xj = c-tf-span{xi\i^j. Consider the problem of 
approximating the signal Xj with an element Xj € Xj , as defined below 

min \\xj-Xj\\^ . (58) 
Then the optimal solution xj exists, is unique and 

£j=J2wA^>i (59) 

where Wji{z) ^ implies (Ni,Nj) € kin(G). 

Proof. For any i ^ define Ei as in ([35]) and observe that Si can be represented as in (|36|). Also note that 

e-j := x-j - ^ Hji(z)xi. (60) 

i 

Consider Cj defined as 

Cj := arg min \\ej - q\\ (61) 

g(^c-tl-span{ei 
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where the transfer functions C^f' (z) are given by the causal Wiener fiher estimating ej from {ei}i^j. Notice 

that, by (|36l) . cj^''(z) is equal to zero if Ni is not a child of Nj. Now. let us consider the optimization 
problem 

Xj:=arg min Ijxj - g|| = V (62) 

q£c-tl-span{x i^i^j — 

where Wji(z) are the entries of the causal Wiener filter solving it. Its solution Xj satisfies also 

Xj — 2, Hji{z)xi + arg min \\ej — q\\ ~ (63) 

— ^ qGc-tf-span{a:i j 

= Hji{z)xi + arg min \\ej - g|| (64) 



where the first equality derives from (|60p and the last one has been obtained by using Lemma [28l Thus we 
have 

Substituting the espression of e^, i 7^ j, as a function of Xi, i ^ j , the assertion is proven. □ 

The following theorem proves the sparsity of the one step prediction operator (or granger-causal operator). 
Granger-causality is a wide-spread technique in econometrics to test the causal dependence of time series. 
If the stronger hypothesis of strictly causal transfer functions Hji(z) is met Granger-causality provides an 
exact reconstruction of parent-child links in a LDG. 

Theorem 35. Consider a well-posed, strictly causal and topologically detectable LDG. Let xi, ...^Xn € ''^J-E 
be the signals associated with the n nodes of its graph. Define Xj — c-tf-span{xi}. Consider the problem of 
approximating the signal z Xj with an element Xj G Xj , as defined below 

min llzxj — .Tjll^ . (66) 
Then the optimal solution Xj exists, is unique and 

n 
i=l 

where Wji{z) 7^ implies i — j or Ni is a parent of Ni. 

Proof. For any i ^ j, define Si as in psp and observe that can be represented as in p6p . Also define 
£j :— Cj. Note that 

— -^ffji(z)a;,. (68) 

i 

Consider the minimization problem 

ej arg min \\zej - = V df^(z)e, (69) 

where the transfer functions Cj^\z) are elements of "J^. We have that Cj^\z) = for any i j. Indeed, it 
holds that 

arg min ||zej — gjl = arg min ||zej — (/jj = (70) 

gEc-tf-span{e:i }"_^ q(Ec-tf-span{ei} 

= arg min \\zej — q\\ (71) 

gGc-tf-span{ej } 
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and, since $e.e^ (w) = for i 7^ j. Conversely, from ((33|) . we findCj| (z) = {zSj{z)}cz ^Sj{z) where 5*^(2;) 
is the spectral factor of ej. Now, let us consider the problem 

arg min \\zxj - q\\. (72) 

gGc-ti-span{a:i 

Its solution Xj is 

Xj = zHjk{z)xk + arg min \\zej - q\\ = 

k 

^J2zH,k{z)xk + clfiz)ej 

k 

= Cjf +Y.^zH,,{z) - df;>{z)H,u{z)]xu. 
This proves the assertion. □ 



7 A reconstruction algorithm 

The previous section provides theoretical results allowing for the reconstruction of a topology via Wiener 
filtering. It needs to be stressed that even in the case of sparse graphs, the reconstruction of the kinship 
topology can be considered a practical solution. The reasons are two-fold. In many situations it is possible 
to measure the outputs of many nodes, while it is important to identify a reduced number of possible 
interconnections among those nodes. For example, DNA-microarrays are devices that allow the measurement 
of gene expression of a cell of a cell. Such data can be useful in understanding which genes interact together 
and realize a specific metabolic pathway and how they are related [10]. Indeed, a cell can express tens of 
thousands of genes while only a few tens must be involved in a gene regulatory network. The possibility of 
reducing the set of involved genes to test the presence of actual interactions with targeted experiments is of 
significant importance [47) . Analogously, in Finance, quantifying the strongest interconnections among a set 
of market stocks can suggest good strategies to balance a given portfolio [8j , thus it is important to have a 
quantitative tool to group together different stocks or, at least, to detect a limited set of possible dynamical 
connections. Similar problems are also faced in neuroscience in order to understand neural interconnections 
|12| . A second reason why the presented analysis is of practical importance is that as a byproduct of the 
reconstruction an optimal model for the node dynamics which can be used for smoothing procedures (in the 
case non-causal Wiener filter are derived) or predictive ones (in the strictly causal case which is out of the 
scope of this article) can be obtained. 

The following algorithm is the natural pseudocode implementation of the reconstruction technique that 
was developed in the previous section. 

Reconstruction algorithm 

. Initialize the set of edges v4 = {} 

1 . For any signal Xj 

2 . solve the minimization problem (|25p 

3. For any W^jj(z) ^ 

4. a,dd {N,,Nj} to A 

5 . end 

7 . end 

8 . return A 
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Step 2 can be computed efficiently for a large number of signals using techniques based on Gram-Schmidt 
orthogonalization as those described in |48]. When checking the condition at step 3, the condition Wji ^ 
can be implemented as ||11/ji(z)|| > athrixi, Xj) where athr{xi, Xj) is a threshold that might depend on both 
the signals Xi and Xj. Moreover, a proper norm must be defined on the space of transfer functions. 



8 Discussion on the robustness of the reconstruction 

In the previous sections an ideal scenario was analyzed, where the node signals are affected by the process 
noises ej which are actively driving the network. This leads to the result tlrat the Wiener filter is a use- 
ful tool for identifying the network topology providing the topology of the smallest self-kin network that 
contains the original system. In most pratical cases the signals are not accessible but are also affected by 
measurement noise. Unfortunately, the presence of measurement noise destroys the sparsity property of the 
Wiener filter. However, it will be shown that when the measurement noise is known to be sufficiently small, 
the introduction of a threshold in the algorithm again guarantees the reconstruction of the topology of the 
minimal self-kin network. In different terms, the Wiener filter property presented in order to reconstruct a 
topology offers a certain degree of robustness that will be quantified. 



Definition 36. A Corrupted LDG (CLDG) is a pair (G^rji) where Q — [G^T-L^ei) is a LDG with dynamics 
X — {xi, Xn} and rji — {rji, 77„} is a set of noises with the property that they are mutually not correlated 
and not correlated with the signals {ej} £ £, either. The output of the CLDG as the setY of signals is defined 
as 

Introducing an auxiliary signal yo which is not correlated with any yj {j — 1, ...,n), the additively corrupted 
topological filter of Q with respect to the measures yj is defined as 



(73) 



\ ^y^^iS^'^'^ytyiS''') 
The following important lemma about the inverse of a matrix is recalled. 
Lemma 37. // Q and Q + A are two invertible matrices the following equality holds 

{Q + A)-i - = -Q-\Q-^ + A-i)-iQ-i. (74) 

The following result establishes a bound on the difference between the topological filter W{z) which can 
be obtained by measuring directly the dynamics of a LDG and the corrupted topological filter W{z) obtained 
by measuring its output. 

Theorem 38. Consider a CLDG {Q^if). Let W{z) he the topological filter of Q and let W{z) he its corrupted 
topological filter. If 

11^-/ , -\mz)\\>Q. (75) 

then, for any z € C, 

\Wjiz) - Wjiz)\\ < / '-^ ^ . (76) 
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Proof. First note that 



thus 



By applying Lemma [571 it foUows that 

Q-i - (Q - A)-i = Q-\Q-^ - A-i)-iQ-i = 
= g-i(A-Q)-iA, 

which implies 

||Q-i-(g-A)-i||<||Q-i||||A||||(Q-A)-i|| 



< 



-'IIIIAIi 



HQ-^III|A|| 

min sp{Q — A) ~ mm sp{Q) — maxsp(A) 

IIQ-'III|A|| 



W 



^-||A|| 



(77) 

(78) 
(79) 

(80) 
(81) 

(82) 
(83) 

(84) 

□ 



An immediate way to apply Theorem l38l is when a function D{z) bounding ||$^(z)|| is known as illustrated 
by the following corollary. 

Corollary 39. Consider a CLDG {G,ri). Let W{z) he its corrupted topological filter. Assume that there 
exists a real valued function D{z) such that 



If, for some z G C, 



and 



\\%{z)\\<D{z). 

\\D(z)\\>Q 



\Wdz)\\ > 



ll*y/^y,^ (^)ll 



\%iz)\\ 



(85) 
(86) 

(87) 



then 



{Nj,N,) e kin{G). 

Proof. By contradiction, assume that {Nj,Ni) ^ kin(G). Then Wji{z) = 0. By Theorem 1551 we have 



\\W,dz)\\ < 



J 3 



\\%iz)\\ 



< 



J 3 



\\Diz) 



which is a contradiction. 



(89) 



(90) 



□ 



Note that the inequality of Theorem [38l needs to hold for any z, so. in this sense, it constitutes a sharp 
criterion to detect the presence of a link in a CLDG. 
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9 Numerical Examples 



In this section illustrative applications of the theoretical results are provided. It is worth observing that 
results were developed for the general class of linear models. Indeed, no assumptions were made on the order 
and causality property of considered transfer functions. 

9.1 Self-kin network 

Consider a ring network of 15 nodes where the dynamics of the links is given by 5-th order FIR filters and 
the noise power is the same on every node. The network topology is provided in Figure [5] The network 




(a) (b) 

Figure 8: A ring network of 15 nodes as the one considered in Example 19.11 (a). The reconstructed topology 
of Example 19.11 Every single links has been detected and, since the network is self-kin, the topology does 
not contain any spurious link (b). 

was simulated for 1000 steps and an implementation of the developed algorithm was applied to the data 
providing the topology of Figure [Hl^b) . 

9.2 Generic network 

Consider a network of 24 nodes for 1000 steps as reported in Figure ^a) and the reconstructed topology 
obtained is depicted in Figure [Hb). 

10 Conclusions 

This work has illustrated a simple but effective procedure to identify the general structure of a network of 
linear dynamical systems. To the best knowledge of the authors, a general analytical formulation of the 
problem of identifying a network is not tackled in scientific literature yet. The approach followed is based 
on Wiener Filtering in order to detect the existing links of a network. When the topology of the original 
graph is described by a self-kin network, the method developed guarantees an exact reconstruction. Self-kin 
networks provide a non-trivial class of networks since they allow the presence of loops, nodes with multiple 
inputs and lack of connectivity. Moreover, the paper also provides results about general networks. It is 
shown that, for a general graph, the developed procedure reconstructs the topology of the smallest self-kin 
graph containing the original one. Thus, the method is optimal in this sense. Numerical examples illustrate 
the correctness and also the reliability of the identification technique. 
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(a) (b) 

Figure 9: A network of 24 nodes as the one considered in Example 19.21 (a) and the reconstructed topology 
(b). Every single links has been detected, but, since the network is not self-kin, as expected, the topology 
contains the additional links between the "kins". 
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